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BAXTER’S INEQUALITY FOR FINITE PREDICTOR 
COEFFICIENTS OF MULTIVARIATE LONG-MEMORY 
STATIONARY PROCESSES 

AKIHIKO INOUE, YUKIO KASAHARA AND MOHSEN POURAHMADI 


Abstract. For a multivariate stationary process, we develop explicit repre¬ 
sentations for the finite predictor coefficient matrices, the finite prediction error 
covariance matrices and the partial autocorrelation function (PACF) in terms 
of the Fourier coefficients of its phase function in the spectral domain. The 
derivation is based on a novel alternating projection technique and the use of 
the forward and backward innovations corresponding to predictions based on 
the infinite past and future, respectively. We show that such representations 
are ideal for studying the rates of convergence of the finite predictor coeffi¬ 
cients, prediction error covariances, and the PACF as well as for proving a 
multivariate version of Baxter’s inequality for a multivariate FARIMA process 
with a common fractional differencing order for all components of the process. 


1. Introduction 

Baxter’s inequality in [2] provides valuable information about the convergence 
of the finite predictor coefficients to their infinite past counterparts (autoregressive 
coefficients) of a short-memory univariate stationary process. It has been used by 
[3] in proving the consistency of the autoregressive model fitting process and the 
corresponding autoregressive spectral density estimator, and in proving the validity 
of autoregressive sieve bootstrap for a stationary time series in mmm- Due to 
the widespread applicability of Baxter’s inequality in these areas and others, there 
has been a great deal of activities in extending it to the setups of multivariate 
stationary processes in [m nu, random fields in [33], and rectangular arrays in 
[34] . In these extensions, the boundedness of the spectral density function of the 
underlying process appears to be an absolutely essential and indispensable part of 
proving Baxter’s inequality. 

In [26], however, Baxter’s inequality was established for univariate long-memory 
processes where the boundedness of the spectral density function is clearly violated. 
Unlike the classical proofs for short-menrory processes involving the orthogonal 
polynomials or the Durbin-Levinson algorithm, the key ingredient of the proof in 
[26] was an explicit representation of the finite predictor coefficients in terms of the 
autoregressive (AR) and moving average (MA) coefficients. The derivation of the 
representation in turn was based on techniques that use von Neumann’s alternating 
projections on the infinite past and future. These techniques were first used by 
[22] and have been developed to derive the needed representations for the finite 
prediction error variances ([221 ESI EE; El]), the partial autocorrelation functions 
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([24l 171l28]h and the finite predictor coefficients ([26]). Unfortunately, most of the 
details of the proofs in the univariate case do not carry over to the multivariate 
setup where, for example, all functions and the sequences of AR and MA coefficients 
are matrix-valued and hence in general do not commute with each other. 

In this paper, for a multivariate stationary process, we prove the desired explicit 
representations for the finite predictor coefficients, the finite prediction error co- 
variances and the partial autocorrelation function (PACF). See Theorems I5.2ll5i4l 
in Section [5] The three new ingredients that enable us to obtain the results in the 
multivariate framework are: 

(i) Use of the Fourier coefficients of the matrix-valued phase function of the 
process in the spectral domain, rather than the AR and MA coefficient 
matrices (see Section [0. 

(ii) Development of an enhanced alternating projection technique tailored to 
the specific needs of the problem at hand (see Section [3]). 

(iii) Use of the forward and backward innovation processes corresponding to the 
predictions based on the infinite past and future, respectively (see Sections 

111 0 and 0). 

Our representation theorems make it possible to extend Baxter’s inequality and 
other univariate asymptotic results to the multivariate long-nremory processes. 
Even when specialized to univariate processes, our method and results are more 
succinct, transparent and improve the known univariate results in several ways. 
For example, our representation theorem for the finite predictor coefficients, i.e., 
Theorem 15.41 below, is stated under the minimality condition (see (M) in Section 
0) only, which is weaker than the condition in the corresponding univariate result, 
i.e., Theorem 2.9 in [26] . 

In this paper, when applying the representation theorems, we restrict our atten¬ 
tion to a class of g-variate long-memory processes, that is, the g-variate FARIMA 
(fractional autoregressive integrated moving-average) or vector ARFIMA processes 
with common fractional differencing order for all components. A process {X k } in 
this class has the spectral density w of the form 

= ( 1 . 1 ) 

where d £ (—1/2,1/2) \ {0} and g : T — > C qxq has rational entries satisfying some 
suitable conditions; see (F) in Section 0 The process {A*,} is described by the 
equation 

(1 - L) d X k = g(L)€ k , k £ Z, (1.2) 

where L is the lag operator defined by LX rn = X m _i and {£*,} is a g-variate white 
noise, i.e., a g-variate, centered process such that = 8 nm I q with I q being 

the q x q unit matrix. See, e.g., 112j . We notice that the parameter d in m 
is the fractional differencing degree in (HUD- The g-variate FARIMA processes are 
multivariate analogues of univariate ones introduced independently by [16] and m- 

We present the following quick summary of the asymptotic results obtained by 
applying our representation theorems to a g-variate FARIMA process {Xf~] with 

O': 

(1) Baxter’s inequality for {X k } with d € (0,1/2) (see Theorem 16.91 belowl. 

(2) The precise asymptotics for the finite prediction error covariances v n and 
v n of {X k } with d £ (—1/2,1/2) \ {0} (see Theorem 16.51 below: see also 
Section 0 for the definitions of v n and v n ). 
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(3) The precise asymptotic behavior for the PACF a n of {AA} with d £ 
(—1/2,1/2) \ {0} (see Theorem 16.71 below: see also Section [5] for the defi¬ 
nition of a n ). 

First, Baxter’s inequality for FARIMA processes is of the form 

n oo 

- hW < K Y, Ill'll. rieN, (1.3) 

j =1 j=n +1 

for some positive constant K, where, for a £ C qxq , ||a|| denotes the spectral norm 
of a (see Section [2J, and <pj and <p n , 3 denote the forward infinite and finite predictor 
coefficients, respectively, of {A*,} (see Sections [2] and 0 respectively, for their precise 
definitions). We also prove a backward analogue of (11.31) : see Corollary 16.101 below. 
We refer to [26] for the corresponding result for univariate long-memory processes 
and pQ 36, 39] for its application; see also [21] for other applications of results 
in [26]. In m, Baxter’s inequality (ll.3|l was proved for a class of multivariate 
short-memory stationary processes. The original inequality m of Baxter [5J was 
an assertion for univariate short-memory processes. See also S3] and E3 Section 
7.6.2], 

Next, the asymptotic results in (2) above are of the form 


+ —Voo +0(n 2 ), 

n —> oo, 

(1.4) 

n 


+ —Voo + 0(n~ 2 ), 
n 

n —> oo, 

(1.5) 


where Voo (resp., Voo) is the forward (resp., backward) infinite prediction error 
covariance of {A&}; see Section IHdl for their precise definitions. We refer to [22] 
[23l 125] 124] for the corresponding results for univariate long-memory processes. See 
also [201 ng for related work. 

Finally, the result in (3) is of the form 

a n = —V + 0(n~ 2 ), n —¥ oo, (1.6) 

n 


where V is a unitary matrix in C qxq which depends only on g (and not d). We 
refer to [22] El EH EH 13 for the corresponding results for univariate long-memory 
processes. In the theory of orthogonal polynomials on the unit circle, the PACF 
appears as the sequence of Verblunsky coefficients and plays a central role. See, 
e.g., [SIGang. 

The above q -variate FARIMA process has a common fractional differencing order 
d for all components. The question arises of proving analogues of (l)-(3) above for 
more general g-variate FARIMA processes which have, in general, different order 
of differencing in each component, i.e., 

/(i - L ) dl 0 \ 


(1 ~Lf := 


V 0 


(1 - L) d " 


with d = (di,..., d q ), instead of (1 — L) d (see, e.g., [12]). We leave this question 
open here; the difficulty stems from the fact that, for such a general q -variate 
FARIMA process, the matrices g(L) and (1 — L) d do not commute with each other. 
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This paper is organized as follows. In Section [21 we give preliminary definitions 
and basic facts. In Section [21 we prove the key projection theorem. In Section [U 
we describe some basic facts about the Fourier coefficients of the phase function 
which is needed in Section [5] In Section [5] we prove the main results, i.e., the 
representation theorems for the finite prediction error covariances, the PACF and 
the finite predictor coefficients of multivariate stationary processes. In Section[6l we 
apply the main results to multivariate FARIMA processes with common fractional 
differencing order for all components, and establish the results (l)-(3) above for 
them. 


2. Preliminaries 

Let C mxn be the set of all complex m x n matrices; we write C q for C 9Xl . We 
write I n for the n x n unit matrix. For a £ C mxn , a T denotes the transpose of 
a, and a and a* the complex and Hermitian conjugates of a, respectively; thus, in 
particular, a* := a T . For a £ C qxq , we write ||a|| for the spectral norm of a: 

||a|| := sup |azt|. 
u£C«,|u|=l 


Here |u| := |'ii i | 2 ) 1 / 2 denotes the Euclidean norm of u = (u 1 ,... ,u q ) T £ C q . 

A Hermitian matrix a £ C ,x? is said to be positive , denoted as a > 0, if (au)*u > 0 
for all u £ C q . When a > 0, we have ||a|| = sup„ eCg i B i =1 (ait)*u. For Hermitian 
matrices a, b £ C qxq , we write a > b if a — b > 0. If a > b, then we have ||a|| > ||6||. 
For p £ [l,oo) and K C Z, l qxq (K) denotes the space of C 9X9 -valued sequences 
{dk}k£K such that ll a fcll P < oo. We write £ qxq for £ qxq (N U {0}) and £ p+ for 

^ = C’( NU {0}). 

Let T := {z £ C : |^:| = 1} be the unit circle in C. We write a for the normalized 
Lebesgue measure d9/(2 tt) on ([— tv, 7r), B([—n, 7r))), where £>([—7r,7r)) is the Borel 
cr-algebra of [—7r, 7r); thus we have cr([—7r, 7r)) = 1. For p £ [l,oo), we write L P (T) 
for the Lebesgue space of measurable functions / : T —> C such that ||/|| p < oo, 
where ||/|| p := {/^ |/(e^)|P C r(d6»)} 1 /P. Let L™ xn (T) be the space of C mxn -valued 
functions on T whose entries belong to L P (T). 

The Hardy class ^(T) on T is the closed subspace of L 2 {T) consisting of 
/ £ L 2 (T) such that e lme f(e l8 )a(d0) = 0 for m = 1, 2,.... Let H™ xn ( T) be the 
space of C mxr,, -valued functions on T whose entries belong to ^(T). Let D := {z £ 
C : \z\ < 1} be the open unit disk in C. We write ^(B) for the Hardy class on B, 
consisting of holomorphic functions / on B such that sup r g [o,i)/!j/( reie )| 2 CT(d<9) < 
oo. As usual, we identify each function / in ^(B) with its boundary function 
f(e l9 ) := lim r -|- 1 /(re* e ), cr-a.e., in U 2 (T). A function h in xn (T) is called 
outer if det h is a C-valued outer function, that is, det h satisfies log | det/i(0)| = 
f*Jog\deth{e l6 )\a(d8) (cf. Definition 3.1]). 

For ggN, let {Xk} = {Xk : k £ Z} be a C 9 -valued, centered, weakly stationary 
process, defined on a probability space (f2, J-, P), which we shall simply call a q- 
variate stationary process. Write Xk = (. Xl,... ,X^) T , and let M be the complex 
Hilbert space spanned by all the entries {X 3 k : k £ Z, j = 1,..., q} in L 2 (H, J 7 , P), 
which has inner product ( x,p)m '■= E[xy] and norm \\x\\m '■= (x,x)m . For K C Z 
such as {n}, (—oo, n] := {n, n — 1,... }, [n, oo) := {n, n + 1,... }, and [to, n] := 
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{m,..., n} with m < n, we define the closed subspace M£ of M by 
M k '■= : 3 = 1, ■ ■ •, q, kG K}. 

We write for the orthogonal complement of in M. Let Pk and Pjk be 

the orthogonal projection operators of M onto M£ and ( M£) ± , respectively. 

Let M q be the space of C 9 -valued random variables on (f l,P,P) whose entries 
belong to M. The norm ||.t||m<i of x = (ad,... ,x q ) T G M q is given by ||s||m 9 := 
(Si=i ll xl |lFor K C Z and x = (ad,..., x q ) T G M q , we write PkX for 
{Pk ad,..., Pk x q ) T . We define P^x in a similar way. For x = (ad,..., x q ) T and 

y= (zd> • • • > V q ) T in M q , 


(x,y) := E[xy*) 


/ ( x 1 ,y 1 ) M 

{x 1 ,v 2 )m ■■ 

■ (x 1 , y q ) M \ 

(x 2 ,y 1 ) M 

(x 2 ,i / 2 )m •• 

■ {x 2 ,y q )M 

\{x q 1 y 1 )M 

{x q ,y 2 )M ■■ 

■ {x q ,y q ) M J 


stands for the Gram matrix of x and y. 

Let {Afc} be a q-variate stationary process. If there exists a positive q x q 
Hermitian matrix-valued function w on T, satisfying w G L\ xq { T) and 

(- X m ,X n } = J” e -^ m -^ e w{e ie )^ n,m G Z, 


then we call w the spectral density of {Afc}. We say that {A'*,} is purely nonde- 
terministic (PND) if n„ e zMd„ n i = {0}. Every PND process {AT*,} has spectral 
density (cf. Section 4 in [351 Chapter II]). We consider the following condition: 


{Afc} has spectral density w such that logdetw G Li(TF). (A) 


A necessary and sufficient condition for (A) is that {A*.} is PND and its spectral 
density w satisfies detw{e l9 ) > 0, er-a.e. (see Theorem 6.1 in [351 Chapter II]). 

In what follows, we assume (A) for {A*,}. Let {Afc '■ k G Z} be the time-reversed 
process of {Afc}: 

Xk '■= X_k, k G Z. (2-1) 

Then, since 

(X n ,X m ) = (A_ n ,A_ m > = J” e-^- m ^w{e- w )^-, 


{Afc} has the spectral density w given by 

w(e ie ) = w(e~ ie ). ( 2 . 2 ) 

In particular, {Afc} also satisfies (A). The spectral densities w and w have the 
decompositions 

w{e l9 ) = h{e i9 )h(e i9 )*, w{e le ) = h{e l9 )h{e i9 )\ tr-a.e., (2.3) 

respectively, for some outer functions h and h in 7L| X<3 (T), and h and h are unique 
up to constant unitary factors (see, e.g., [351 Chapter II] and [HU Theorem 11]). 
We define the outer function h$ in iL| X9 (T) by 

h(z) := {mV- (2.4) 


Then, h$ satisfies 


w{e i9 ) = h t (e i9 yf H (e i9 ), 


(j-a.e. 


(2.5) 
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We may take h$ = h for the univariate case q = 1 but there is no such simple 
relation between h and h$ for q > 2. We call h*hf x the phase function of {A*,}. 
Since 

{Me^^VrM^r/^r 1 = = i q 

holds cr-a.e., it is a unitary matrix valued function on T. See Section [4] and [35] 
page 428]. 

Let 


X k = 


—ik6 


A(d6), 


fcez, 


be the spectral representation of {A'*,}, where A is the C 9 -valued random spectral 
measure such that 

<t>{e' e )A(M), f f(e a )Aw) = f <j>{e ie )w{e ie )^{e ie )*^- 

for (j),ip £ L(w) with L(w) being the class of measurable <j> : T —> C lx,? satisfy¬ 
ing Jf^<f(e' l ' 8 )w(e l8 )<j)(e' l8 )*a(dd) < oo (cf. [35] Chapter I]). We define a g-variate 
stationary process {£*, : k £ Z}, called the forward innovation process of {A*,}, by 


: = 


e~ ike h(e i8 )~ 1 A(d9), 


k £ Z. 


( 2 . 6 ) 


(2.7) 


Then, {£ fc } satisfies (£„,£ m ) = 5 nm I q and 

M *-o o,n] = M (-oo,n]’ ^ £ Z 

(cf. Section 4 in J3HJ Chapter II]), whence, for n £ Z, {f J k : j = 1,..., q, k> n + 1} 
becomes a complete orthonormal basis of (M^^ n ])' L - 

On the other hand, the spectral representation of {X k } is given by 

X k = [ e~ ik8 A(d0), k£ Z 


with the C 9 -valued random measure A defined by 

A(E):=A(-E), E £ B((—n,n)), (2.8) 

where —E := {—9 : 9 £ E}. Let {f k '■ k £ Z} be the forward innovation process of 
{A fc } given by 

/ TV 

e~ ike h(e ie )~ 1 A(d9), k£ Z. 

-TV 

Then, we easily see that {£*.} satisfies (£ n ,£ m ) = 5 nm I q and 

n £ Z, 


(2.9) 


M f \ — j\R I, 

[—n, oo) ( —oo,np 


( 2 . 10 ) 


whence, for n £ Z, {ffi. : j = 1,..., q, k > n + 1} becomes a complete orthonormal 
basis of (AL[ X noo P _L . We also call {f k } the backward innovation process of {A*,}. 
Then, {£&} turns out to be the backward innovation process of {A*,}. 

We define, respectively, the forward MA and AR coefficients c k and a k of {A*,} 
by 




Z k c k , 


~K z ) 1 = 


z k a k , 


k—0 


k —0 


Z G D, 


( 2 . 11 ) 
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and the backward MA and AR coefficients Ck and dk of {Xk} by 

oo oo 

h( z ) = z k Ck, —h(z)~ 1 ='^^z k dk, z £ D. (2-12) 

fc=o fc=o 

It should be noticed that Ck and afc (resp., Ck and dk) are the backward (resp., for¬ 
ward) MA and AR coefficients of the time-reversed process {Afc}, respectively. All 
of {c fc }, {a fc }, {cfc} and {afc} are C 9X9 -valued sequences, and we have {cfc}, {c*,} € 
£ 2 + 9 and coao = codo = —I q . We have the following forward and backward MA 
representations of { Xk }, respectively: 

n n 

A n = 'y ] c n —k£,ki A_ n = 'y ] c n —k^ki n £ Wj (2.13) 

k=—oo k=—oo 

(cf. Section 4 in 138- Chapter II]). If we further assume 

{a fc },{d fc }e^ 9 , (2.14) 

then the following forward and backward AR representations of {A'fc}, respectively, 
also hold: 

n n 

'y ] Q'n—kXk T £n = 0, ^ ] d n _fcA4“ — 0, Tl IE 21 (2.15) 

k=—oo k=—oo 


(see, e.g., the proof of |221 Theorem 4.4]). From (12.15L we obtain the following 
forward and backward infinite prediction formulas, respectively, for {A/;}: 


oo oo 

-P(-oo,-i]A’o = 'y ] ^fcA —k, Ao = ^ ] ^A^. 

fc= 1 fe=i 


Here 


fik .- CQttfc, (j)k ■ - CqU/j;, h FJ. 


(2.16) 


We call 4>k (resp., </>&) the forward (resp., backward ) infinite predictor coefficients 
of {A*,}. It should be noticed that 4>k (resp., <f>k) are the backward (resp., forward) 
infinite predictor coefficients of {A*,}. 


3. A Projection theorem 

In this section, we present a projection theorem which facilitates finding explicit 
representations of the finite predictor coefficients, the finite prediction error covari¬ 
ances and the PACF of a q- variate stationary process {Afc}, in terms of the Fourier 
coefficients of the phase function. 

Let TL be a Hilbert space with inner product (•,•). Let I : H —> H be the 
identity map. For a closed subspace A of H, we write Pa for the orthogonal 
projection operator of H onto A and Pfi for that onto the orthogonal complement 
A 1 - of A, that is, P^ = I — Pa- For closed subspaces A and B of LL, von Neumann’s 
Alternating Projection Theorem (cf. [37] §9.6.3]) states that ( PaPb) u converges to 
Pac\B as n —> oo in the strong operator topology. From this, we have the following 
projection theorem. 




Theorem 3.1 ([22l|24]). Let A and B be closed subspaces of H. Then, we have, 
for x,y G H, 

CO 

PAnB x = E {PB(PAP B ) k X + P^P B (P A P B ) k X } , (3.1) 

k—0 

co 

( P AnB x , P AnBy) = E {( P B( P APB) k X,PB(PAPB) k y) 

tl0 (3-2) 

+(PiP B (P A P B ) k x,PiP B (P A P B ) k y)} , 
the sum in (E3D converging strongly. 

The assertion (13.21) (resp., (13.1|> ) is an abstract form of (221 Theorem 4.1] and 
[24l Theorem 3.1] (resp., Remarks to [24j Theorem 3.1]), and can be proved in a 
similar way. 

For our applications in this paper, we need the next variant. 

Theorem 3.2. Let A and B be closed subspaces of H. Then, we have 

CO 

PAn B a = E { P B ( p i P B )*« - ( P£P£) k+1 a } , a € A, (3.3) 

k =0 

co 

( P AnB a i, P AnB a 2) = J2(P B {P A P B ) k a 1 ,a 2 ), a u a 2 € A, (3.4) 

k =0 
co 

( P AnBa,P A nB b ) =-J2(( P A P B ) k+la ’ b )’ a£A,beB, (3.5) 

k—0 

the sum in da converging strongly. 


Proof. If a G A, then 

P B P A P B a = P B (I ~ P A )P B a = —P B P A P B a = -P&P£(I ~ P B )a 

= Pb p a p b°" 

Hence, we have, for k = 1,2,..., 

P^(P A P B ) k a = Pi(PiP^)(P A P B ) fc - 1 a = • • • = P B (P A P B ) k a, 


and, for k = 0,1,..., 

P^P B (P A P B ) k a = PUJ - P B )(P A PB) k a = — P A P B {P A P B ) k a 

= -(PiPs) k+1 a- 


Therefore, (13.31) and 


( P AnB a i, p ioB a 2) = E {( P s( P i P s) ma i> P B(- p i- P B) m «2) 

m =0 


(3.6) 


+(( p a p b ) m+ V, ( p i p s ) m+ 1 a 2 )} , ar,a 2 € A 

follow from JO and da , respectively. However, we have, for ai,a 2 E A and 
to = 0 , 1 ,..., 


( P B( p i P B) m «i, P B ( p i P B) m a 2 ) = (Pi(P|Pi) 2m ai ,a 2 ), 

(( p |Pir +1 ai,( p | p ir +1 a 2 ) = {P B {P A P B ) 2m+1 ai, a 2 ). 


9 


Thus, (13.41) follows from (13.61) . 

Let a £ A and b £ B. Then, (P^a, P^b) = 0. For m = 1, 2,..., we have 
P£(P A P B ) m b = P^PAiPsPAr^b = 

whence 

(Pi(p A p B ra,pi(p j4 p B ) m 6) = -(pi(pipira,(p^pir&) 

= -((p£p£f m a,b)- 

Similarly, we have, for m = 0,1,..., 

P|Ps(P4Ps) m & = Pj[(P B P A ) m b = Pi(P^Pi) m &, 

whence 

(P|P B (P4P B ra,P|P B (P4P B ) m &) = -((P|Pi-r +1 a,Pi(P^Pi) m &) 

= -((PAP B ) 2m+1 a,b). 

Thus, (13.51) follows from (13.21) . □ 

In the applications of this paper, A and B correspond to the infinite past and 
future of a multivariate stationary process. 

4. Fourier coefficients of the phase function 

Let {A*,} be a q -variate stationary process satisfying the condition (A), with 
spectral density w. Let {Xk}, h and h # be as in Section [2] We define a sequence 
{/3k}kL -oo as the (minus of the) Fourier coefficients of the phase function 

fa := - r e -^ hijOyh ^ 9 )- 1 ^-, k £ Z. (4.1) 

Since h*hf x is unitary matrix valued (see Section [2]), we see that {/?*,} £ i\ X9 (Z). 
The sequence {/3k} plays a central role in our representation theorems. 

Recall the forward and backward innovation processes {£&} and {£&}, respec¬ 
tively, of {Xk} from Section [2] 

Lemma 4.1. We assume (A). Then we have 

= —f3j+k ! {ik: £j) = — Pk+ji j,k£%. 

Proof. From (12.41) . (12.81) and (12.91) . we see that 

ik ■■= [ e ike { hjj l { e i 0 )*}~ 1 A { d 9 ), k £ Z. 

J 7r 

Combining this with (12.31) and (12.61) . we obtain 

= [_ e- i ^+ fc ) e /i(e ie )- 1 /i(e^)/i(e ie )*/ l# (e ie )- 1 g 

= fj-^Wh^yhypO)- 1 ^- = -is j+k , 

which also implies the second equality. □ 
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Remark 1. By Lemma 14.11 we have the following mutual representations between 
{6c} and {6-}: 

OO OO 

6 = — fij+kiijk, £k = ~ Pk+j^i- 

k=— oo j=—oc 


Lemma 4.2. ITe assume (A). Then, for {s;} £ and n£Z, we have 

( OO \ OO / OO \ 

X] ) = ~ S lPn+j+l +1 ) ln+j + 1, (4.2) 

J =0 / i=o \z=o / 

( OO \ oo / oo \ 

I = — ( y; s;/3* + j + j +1 J 6- (4-3) 

z=o / j=o \ i = o / 

In particular, {J2Zo *lPn+j+l+ 1}“ 0 > (E/=o sj/^+j+z+J^o e ^ 2 + ? - 

Proof. By LemmaHj] we have (Eto s «6>ln+j+i) = - Ei=o Sz/3„ +J - + z +:L . On the 
other hand, {f k +j+i '■ k = l,... ,q, j > 0} is & complete orthonormal basis of 
(MA 00 ))‘ L . Thus (14.211 follows. We can prove (14.31) in a similar way. □ 


Remark 2. In Lemma [4721 the map {s;}^ 0 i-*- (Efco s lPn+j+l+i}JLo defines a 
bounded Hankel operator T n : £ 2 + q —>■ £%* q with block Hankel matrix 

(Pn +1 Pn+2 Pn+3 “ '\ 

Pn+2 Pn +3 Pn +4 
Pn +3 Pn+4 Pn+3 

V : 

(cf. [35]), and similarly for {s ; }^ 0 H> (E^o s lPl+j+l+i\T=o- 

Lemma 14.21 allows one to define, for n £ N and k £ N U {0}, the sequences 
{b k ntj }f= o £ by the recursion 


b 0 nJ = S 0j I q , bff 1 =Y,b 2 n k tl Pn +j+ i+u bl k + 2 = 
1=0 

Y,%? 1 Pn +j+ l + 1' 
1=0 

(4.4) 

For n G N, we define the sequence {WA}£L 0 in M q by 



K k = P(--oo,-l] (^-n.ooj^-oc,-!])**«>, 

k = 0,1,..., 

(4.5) 

W 2k+1 = -(^E.oq)^- oc.-l]) fc+1 ^0, 

A = 0,1,.... 

(4-6) 


Proposition 4.3. We assume (A). Then, for n G N and IgNU {0}, we have 


oo OO 



W„ 2fe = co5>^.6, 


(4.7) 


i=o 

3= 0 


and 

(W 2fc ,A 0 )=co6 2fc 0 cS, 

(Wf +1 ,X_ ( „ +1) ) = C0 6^ +1 cS. 

(4.8) 

Proof. 

Note that, from the definition of W„, 



pj/2fe+l _ _ p-L w2fe 

r r n [—n,oo) n ? 

^2fc+2 _pJ- ,,W 2k+1 

vy n ± ( — oo, — l] n 
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We prove (|4.7|) by induction. First, from (I2.7j) and (|2.13|) . we have 

oo 

w ° = P ( E,-i]*o = c 0 £ 0 = c 0 E h \{ t c r 

j =0 

For k = 0,1,..., assume that W 2k = c 0 Y°jLa Then, by (14.21) . 


W 2k+ 1 = -R- 1 , 

y n ± [— n,oo) 


( oo \ oo / oo \ 

c 0 E b n% | = Co E ( E 1%l0n+i+l+ 1 

i=0 / 1=0 \i=0 / 


in+j'+l 


E i2fc+lc 

“nj Kn+j+1, 

3=0 


and, by (14.31) . 


W 2k +2 = ^ | coE^EWi 

3=0 


OO / oo 


=E EE +1 #E+m = coEE/E 

i=o \;=o / i=o 

Thus (14.71) follows. We obtain the first (resp., second) equality in (14.81) from the 
first (resp., second) equalities in (14.71) and (12.131) . □ 

Lemma T4.21 also allows one to define, for n G N and k GN U {0}, the sequences 
{b k d }ft 0 € i q 2 l q by the recursion 


10 r j 12k+l 

b n,j ~ d 0jlq, b n j 


= E S " 


;=o 


2 \p: +j+ i + i, EE = EEE/Wm- (4-9) 

1=0 


Proposition 4.4. We assume (A). Then, for n G N and k G N U {0}, we have 
Eo > 0 and b 2 n k 0 > 0. 

Proof. Let A = M^f n ^ and B = _ 1 j. Then, in the same way as the proof 

of (13.41) in Theorem 13 21 we have 


(W 2k ,X o> = 


(P^(P^P^) m X o, Pg(P^Pg) m Xo), k = 2m: even, 
{(PaPbT^X o, (PiPir +1 Xo), * = 2m + 1 : odd. 


This and the first equality in (14.81) give coEo c o > 0 or b^ 0 > 0. The second 
equality follows from the first one applied to {A'*,}- □ 

5. Representation theorems 

In this section, we develop explicit representations for the finite predictor coeffi¬ 
cients, the finite prediction error covariances and the PACF of a q- variate stationary 
process {Xk}, in terms of the sequence {Bj} defined in SectionHJ We focus on the 
one-step ahead predictions to keep the notation simple. 

In deriving the representation theorems for the finite predictors of a g-variate 
stationary process {Xk}, the following intersection of past and future property of 
{Xk} plays a key role: 

M^-i] n m*„ )00) = m(L 


n = 1,2,.... 


(IPF) 






12 


A useful sufficient condition for (IPF) is the following minimality condition: 
{Xk} has spectral density w satisfying det w(e z9 ) > 0, cr-a.e., 
and w~ x £ L qxq (T). 


In fact, by mi Corollary 3.6], (M) implies (IPF). The condition (M) also implies 
(A) by [35, Lemma 2.5 and Theorem 2.8], or more directly by 


| log det | = g| log(det w) l ^ q \ < q |(detu>) 1 / 9 + (det in) 
Kl ... Xq y/ q + {Xl i... x -r ) i/ q } 

Ai + 


1 


= q 
< q 


+ A g ^ 1 H-+ A ? 


= Tr w + Tr w 


-l 


where Ai,...,A 9 denote the eigenvalues of w and we have used the inequality 
I log y\ < y + {l/y) for y > 0. 

The property (IPF) is closely related to the property 

Mf 00) _ 1] nM [ ^ oo) ={ 0} (CND) 

called complete nondeterminacy by m- In fact, by [571 Theorem 3.5], (IPF) and 
(CND) are equivalent under (A). The condition (CND) is also closely related to 
the rigidity for matrix-valued Hardy functions (see [ 55 ]). It should be noticed that 
if {Xk} satisfies (IPF), then so does the time-reversed process {A'*,}, and that the 
same holds for (M) and (CND). 

Recall W% from (14.51) and (14.61) . The next proposition is a direct consequence of 
(13.31) in Theorem 13.21 


Proposition 5.1. We assume (IPF). Then , for n £ N, we have 

OO 

P [ ^,_ 1] A 0 = ^IT n fc , 

k -0 

the sum converging strongly in M q . 


Proof. The equality follows from (IPF) and (13.31) in Theorem 13.21 applied to A = 
Mr x ,, B = M; y ,, and a = XT j = 1,. .., q. □ 

Under (A), and for n £ N and k = 1 ,n, the forward and backward finite 
predictor coefficients £ C qxq and cj) n ^ £ C qxq , respectively, of a g-variate 
stationary process {A*.} are defined by 

P[—n,— l]Xo — 4>n. lA_i -(-••*-(- ^ n ,raA_ n , (5.1) 

P[—n,—1]A^^-j-l) fn.lX — n -(-••*-(- (j) n ^ n X~l- (5.2) 

Recall c 0 , c 0 , (3j , b'f k 3 and b 2 r fj from (12.111) . (12.121) . (14.11) . (14.41) and (14.91) . re¬ 
spectively. Here is the representation theorem for and 4> n ,m which are closely 
related to the PACF of {Xk}. 


Theorem 5.2. We assume (A) and (IPF). Then, for n £ N, 


00/00 


00/00 


~-l 


i,n — Co ' j y ] b n j(3 n+ j | c 0 , 
k— 0 \j=0 


^ = J2' b n, a * 


jk'n+j 


k —0 \j —0 


C 


-1 

0 
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Proof. Since P^ n _^X 0 = -<j> n ,nX- n = -4> n ,nCo^n mod A/jA„ +loo ), we have 

{P[— n ,—l]Xoi£n) = 0n,rj Co(^ni Cn) = ^n,n Co- 
On the other hand, from Propositions 15. II and 14.31 and Lemma [LTJ we get 

OO 00/00 

(PlVn^Q = = - C 0 E E 

fc=0 /c—0 \ 0 

Thus the first formula follows. We obtain the second formula by applying the first 
one to the time-reversed process {A'*,}, □ 



For n = 0,1,, we define the forward and backward finite prediction error 
covariances v n and v n , respectively, of a q- variate stationary process {A^} by i>o = 
v 0 = (A 0 ,A 0 ) and 

Vn := (-P[_ ni _i]Ao,P > [_„ i _ 1 ]Ao), n= 1,2,..., (5.3) 

:= (-^[—n, —1]^—(ra+l), ■^ > [_ra,_l]^_(™+l)), 71=1,2,.... (5-4) 

Notice that v n (resp., v n ) is the forward (resp., backward) finite prediction error 
covariance of the time-reversed process {A'*,}. In this paper, under (A), we fix the 
definition of the partial autocorrelation function (PACF) a n of {Xfc} by 

f(^o) _1/2 (A 0 ,X_i)({;o) _1/2 , 7i = l, 

|(7) n _i)- 1 / 2 (P [ ^ n+lj _ 1] Ao,E n+li _ 1] A_ n )(u n _i)- 1 / 2 ) 71 = 2,3,... 

(cf- Q33 )• 

The next theorem gives explicit representations for v n , v n and a n . 


Theorem 5.3. We assume (A) and (IPF). Then, for n € N, we have 


Vn — Cq 


E« 

\k =0 


2k \ 


0 I c 0> Vn — Co 


E« 

\k=0 
/ oo 


2k | 
n ,0 I c 0? 


(-P[-7l-|-l,-l]^0j P[-n+ 1,-1] 


A-„) = c 0 E 5 'E cS- 


\k =0 


(5.5) 

(5.6) 


Proof. First, by (IPF) and (13.41) in Theorem 13.21 applied to A = MA £? = 
Af**,,-ij and ai = a 2 = Aj) (i, j = 1,..., q), we have v n = ££L 0 (Wi? fc > A 0 ). 
This and (14.81) give the first equality in (15.51) . Next, we obtain the second equality in 
(15.51) by applying the first one to the time-reversed process {A*,}. Finally, by (IPF) 
and (13.51) in Theorem 13.21 applied to A = AfA s, B = M^A^ _ 1 , and a = Xq, 
b = X J _ {n+1) (i,j = 1,..., q ), we have 


<P[E,-!]*<>, P[E,-i]^-(n +1 )> = E(^ 2fc+1 ^-("+i))- 

k =0 


This and (14.81) give (15.61) . 


□ 


We can prove 


n+1,-1] 


-11 Aq, P[_ n+1 _!] A_ 


,> = 


iVn— 1 5 


n = 2, 3, 
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in the same way as in the univariate case (cf. Corollary 5.2.1 in |8j). From this, we 
have 

= {Pn— l) ^ (fn,n{Pn— l) ^ i Tl — 1,2,..., (5-7) 

and so Theorem l5.2l with (15.511 in Theorem 15.31 gives another explicit representation 

of OL n . 

We turn to the representation of all the finite predictor coefficients <p rl) j and (f> n j- 
It turns out that, to deal with this problem, we need to assume the minimality (M) 
which is more stringent than (IPF) or (CND). A q -variate stationary process { X k } 
satisfying (M) has a dual process {X' k : k G Z}, characterized by the biorthogonality 
relation (Xj,X k ) = 5j k I q ; see [32] for more information. Recall a k and d k from 
(12.111) and (12.121) . respectively. The dual process {X' k } admits the following two 
MA representations: 


X n = -J2 a Un+k , x’_ n = - E a* k £ n+k , n G Z. 


k—0 


k =0 


Here notice that (M) implies 

{a fc },{d fc }G^. 

By (15.91) . we can also define, for n G N and k, j G N U {0}, 

oo oo 

4> 2 n k j ■= Co X! b l k i a j+i- C/ 1 := c ° E b l k ,l~ la i+l’ 


1 =0 


oo 


12 k ~ 
' } n,l a j+h 


P+ 1 • 


:=£ °E^ + E+*- 


(5.8) 

(5.9) 


12k ~ £2 

1,3 ' C ° Z_^ b n 

1=0 1=0 

Here is the representation theorem for the finite predictor coefficients. 


Theorem 5.4. We assume (M). Then, for n = 1,2,... and j = 1, ..., n, 

OO OO 

= EiC + Ci+l}- E, = J- (5-10) 


k—0 


k—0 


Proof. From {X k , X'-) = S k jl q , we have {P^ n _ x] X 0 , XX) = for j = 1,..., n, 

and, from Proposition 15. II we find that 

OO 

(P[\- 1] Xo,XX) = J2U W n k ’ X -j) + (W^ k+ \XX)}. 

k =0 

Moreover, from Proposition 14.31 and (|5.8|) rewritten as 

oo oo 

X—j ^ ^ X—j ^ ^ Q'n —? 

Z=-j Z=-(n-j+l) 

we have 

oo 

(K k , x -j) = -coE 6 ^+* = 

Z=0 

oo 

/TT^2fc+l W \ \ ^ 7 2fc+l ~ _ _ i2k+l 

\**n C 0 / v *n,l Q j n-j-\-l -\-1 ^ 71 , 71 —j + 1* 

1=0 

Combining, we obtain the first equality in (15.101) . Its second equality follows from 
the first one applied to the time-reversed process {AA}- □ 
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6. Applications to long-memory processes 


In this section, we apply the representation theorems in Section [5] to a q- variate 
FARIMA process with common fractional differencing order for all components and 
derive the asymptotics of the finite prediction error covariances and the PACF as 
well as that of the finite predictor coefficients, and establish Baxter’s inequality. 


6.1. Univariate FARIMA processes. We start with some properties of univari¬ 
ate FARIMA(0, d, 0) processes which we need in our perturbation technique below. 
This technique reduces the study of asymptotic properties of multivariate FARIMA 
processes to that of the corresponding problems for univariate FARIMA(0, d, 0) pro¬ 
cesses. 

For d £ (—1/2,1/2) \ {0}, let {Y/ : k £ Z} be a univariate FARIMA(0, d, 0) 
process with spectral density 

wy{e z6 ) = |1 — e l9 \~ 2d , 9 £ (— 7T, 7r) (6.1) 


(see pj5} [19] ; see also |H §13.2]). Then the variance u o := .E[|Yo| 2 ] is equal to 
T(1 — 2d)/r(l — d) 2 and the n-th finite predictor coefficients ip n , n of {Y/} (see 
(EH)) are given by 

i>n,n = -^, ne N. (6.2) 

n — a 

Let u n be the finite prediction error variance of {Yj,} defined by (15.31) with { X *,} 
replaced by {Y/}, for which we use the notation u n rather than v n . Then the 
Durbin-Levinson algorithm implies u n = Ug ]+=i{l ~ (V’fc.fc) 2 }> whence 


T(n + 1 - 2d)F(n + 1) 

r(n + 1 - d) 2 


n = 0,1,.... 


(6.3) 


For u n , we present next its precise asymptotic behavior. 


Proposition 6.1. For d £ (—1/2,1/2) \ {0}, we have u n = 1 + ( d 2 /n) + 0(n 2 ) 
as n -A oo. 


Proof. By Stirling’s formula r(x) = y/2ne x x x+{ ' 1 / 2 ' , {\ + (l/12a;) + 0(x 2 )} as 
x —> oo and 

-d 


n + 1 — 2d 


n T 1 

as n —> oo, we have, asn-> oo, 
r(n + 1 - 2d)r(n + 1 ) 
F(n-t-l-d) 2 

n+1 —a 


, , 2d 2 ^ _ 2 , y/(n + 1 — 2d)(n + 1) _ 2 

= 1 + - + Oyn ), - r —- - -= 1 + 0(n 

n (n + 1 — d) 


u n = 


= 1 - 


n + 1 — d 


1 + 


n + 1 — d 


n+1 —a 


2d 2 

1 + — + 0(n" 2 ) 
n 


On the other hand, by rHopital’s rule, we have, for aGl, 


(+y 


= e — 


a 2 e a 

2x 


+ 0(x ), x —> oo, 


whence, as n —> oo, 


1 - 


n + 1 — d 


n+1 —d 


i + 


n + 1 — d 


n+1 —d 


= < 1-h 0{n 

n 


—2 > 


Combining, we obtain the proposition. 


□ 
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Since 


i0 _ J|1 - e iS |e (i / 2 )( e_7r ) if 0 < 6 < 7T, 

“ ||1 - e «| e (i/ 2 )(e+^) if —7r < 0 < 0, 

the phase function 

n(e ld ) := (1 — e ie )~ d /(1 - e l6 )~ d 
of the univariate FARIMA(0, d, 0) process {Y k } above is given by 




e id(d-n) if 0 < 0 < 7T, 
e id(8+ir) if -7T < 0 < 0. 


(6.4) 


Therefore, the minus of the Fourier coefficients of the phase function Ll(e lS ) for 
{Yfc}, which we write as p n rather than j3 n , are given by 


Pn — 


—inO 




dO 

^2tt 


sin(7rd) 


n(ri — d) ’ 

One can also obtain (16.51) using 0 Remark 1 and Lemma 4.4]. 


neZ. 


(6.5) 


Lemma 6.2. Let {sfc}fc)L-oo be a complex sequence such that Y^kL-oo ^ 2 l s fc| < 
Then, we have 


lim n 

n—> oo 



oo 

^ ^ Pn—k^k 


Y Sk 


k=—c 


k=—c 


oo 

y ks k . 

k=— oo 


Proof. Since p n -k/ Pn = {n— d)/(n — k — d), we have 

f OO OO \ c 

^ E 


n | Pn* 2^ Pn-kSk- ^2 Sk I = 
k=— oo 


k=— oo 


k—— oo 


nksk 

n — k — d 


For k £ Z, the function / fcid : Z —► [0, oo) defined by 


fk,d ( n ) : = 


nk 


n — k — d 



fc(fc + d) 


n — (fc + d) 

takes the maximum value at either n = k — 1 , k, or k + 1 , whence 

'fc(fc-l) fc 2 fc(fc + l) 


max fk d (n) < max 

nEN 


< cAr 


( 6 . 6 ) 


1 + d ’ |d|’ 1 — d 

for some c € (0, oo). Therefore, we have dominated convergence, asn-> oo, on the 
right of (EH), and the sum converges to Y2kL-oo ^ Sk , as desired. □ 


6.2. Multivariate FARIMA processes. Let B := {z £ C : |,z| < 1} be the 
closed unit disk in C. We consider the following condition for g : T —> C qxq : 

the entries of q(z) are rational functions in z that have 

_ - (C) 

no poles on B, and det g has no zeros on B. 

The condition (C) implies that g is an outer function in id| x<3 (T). 

Lemma 6.3. For g : T — > <C qxq with (C), there exists g : T — > C qxq that satisfies 
(C) and 

g(e- ie )g(e- ie )* = ~g(e ie )~g(e ie y. (6.7) 

The function g is uniquely determined from g up to a constant unitary factor. 
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Proof. Since the entries of g(l/z) are rational, the lemma follows from the proof of 
Theorem 10.1 in j38j Chapter I], □ 

Let g and g be as in Lemma 16.31 As in (12.41) . we define the outer function gj in 
H qxq (T) by 

SliO) : = {g(z)Y- (6-8) 

Then, gj satisfies both (C) and 

g{e ie )g(e ie y = g^e ie y 9 ^e ie ), 6 e [-tt, tt). (6.9) 

It should be noticed that the proof of Theorem 10.1 in [35} Chapter I] is constructive, 
whence so is the above proof of the existence of g and g y. 


g(z) = 


Example 3. For c € D, let 

\/{l- C z) l) ' 

Then g satisfies (C). From the proof of Lemma 16.31 and (16.81) . we obtain 

l-|c| 2 1 

1-lcl 2 


9t(z) = 


1 


Vl-|c| 2 + |c| 4 \-l + 


-cF + 


1 


1 — CZ 1 — CZ t 

One can also directly check that gy satisfies both (C) and (16.91) . 


Let d € (—1/2,1/2) \ {0}, and let {X^} be a q- variate stationary process which 
has spectral density w of the form 

w{e i8 ) = |1 - e i9 \- 2d g(e ie )g{e ie y, where g : T -» C« x « satisfies (C). (F) 

We call the process {A'*,} a q-variate FARIMA process. We easily find that {X &} 
satisfies (M), whence (A) and (IPF) (see Section[5]). Let g and gj be as in Lemma 
I6.3l and (16.81) . respectively. In what follows, as the outer functions h and h for {Xk} 
in Section O we take 

h(z) = (1 - z)~ d g(z), h = (l-z)~ d g(z). (6.10) 

Then, defined by (12.41) is given by 

H (z) = {l-z)~ d gyz). (6.11) 

From the second equality in (16.101) . we see that the time-reversed process {Afc} of 
{Xk} is also a g-variate FARIMA process satifying (F) with the same differencing 
order d and g as g. 

Let {c n } and {c n } be the forward and backward MA coefficients of {Xk}, re¬ 
spectively (see (12.111) and (12.121) 1. Then 

c 0 = ft(0) = g(0), co = h(0) = ft.j(0)* = gj(0)* = g(0). (6.12) 

The sequence {j3 n } for {Xk}, which is defined by (14.11) . is given by 

Pn = ~ f e--^(e")g(e i0 )*g # (e ie )- 1 ^, n G Z, 

with f2(e l£l ) in (16.41) . 

We define a q x q unitary matrix U by 

u-^giiygyi)- 1 . 


(6.13) 
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Recall the spectral norm ||a|| of a £ C qxq from Section [2] The next proposition 
may be viewed as an improvement of Proposition 4.5 in [7]. 

Proposition 6.4. For d £ (—1/2,1/2) \ {0}, let { X &} be a q-variate FARIMA 
process with (F). For n £ N, define A n ,A' n £ C qxq by 

Pn = Pn{Iq + A„)f7 = p n U(I q + A/), 

respectively. Then there exists a positive constant M satisfying the two conditions 

||A n || < Mn _1 , n £ N, (6-14) 

\\A'J < Mn~\ n £ N. (6.15) 


Proof. We put G(z) := { 3 ( 1 / 2 )}*. Then g{e ie )* g^e 16 ) -1 = G{e ie )g^(e l6 )~ 1 holds. 
By the property (C) for g and g$, there exists an open annulus A containing the unit 
circle T such that both G{z) and g^z) -1 are holomorphic in A, whence G{z)g^{z)~ 1 
has the Laurent series expansion 

OO 

Giz)gt(z)- 1 = Y s k zk > z e A. 

k =—00 


Since A D T, the entries of Sk decay exponentially as k —> ± 00 . Moreover, since 
Pn = Y^kL -00 Pn-kSk and U = Y%L- 00 s ki we have 


An = I P n ^ ' Pn—kSk ~ ^ ] s k J U , 

\ k=—oo k=—o o / 

( 00 00 \ 

Pn 1 Y P^-kSk - Y Sk ) • 

k =—00 k =—00 / 


Therefore, the proposition follows from Lemma 


□ 


6.3. Asymptotics of the finite prediction error covariances. In this section, 
we derive the precise asymptotics of the finite prediction error covariance matrices 
for q -variate FARIMA processes with (F). 

For d £ (—1/2,1/2) \ {0}, let {AT*,} be a 3 -variate FARIMA process with (F). 
Let v n and v n be the forward and backward finite prediction error covariances of 
{Xfc} defined by (15.31) and (15.41) . respectively. We define the forward and backward 
infinite prediction error covariances Voo £ C qxq and Voo £ C qxq , respectively, of 
{X k } by 

Voo := (Pt-oo,-!}* 0 , ^oo,-!]^} = Co Co, (6.16) 

Voo ■■= (P[l,oo) A'o, P[loo)* 0 > = ~c 0 cl (6.17) 

where {c„} and {c„} are the forward and backward MA coefficients of {X k }, re¬ 
spectively (see (12.111) and (12.12)1 ). It should be noticed that Ax, (resp., i>oo) is the 
forward (resp., backward) infinite prediction error covariance of the time-reversed 
process {Xk}- 

Theorem 6.5. For d £ (—1/2,1/2) \ {0}, let {A*,} be a q-variate FARIMA process 
with (F). Then and \1.5\) hold. 
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Proof. Let u n be as in it is the n-th finite prediction error variance for a 

univariate fractional ARIMA(0,d, 0) process {Yfe} with spectral density (16.11) . We 
prove the assertion CE3D by comparing v n with u n . 

From the representation of v n in (15.51) . we have 

v n ~ v oo = Co ^n,0^ C 0' 

Similarly, u n can be expressed, in terms of { pj} in (16.51) only, as 

OO 

k =1 


where, for n G N and k G N U {0}, 0 G l 2 + is the analogue of { b k for 

{Yfc}, dehned by the recursion 

OO 

r° n ,j = s oj, rH 1 = ^ r*, p„+j+/+i- (6.18) 

7=0 

Let A n and M be as in Proposition 16.41 Recall U from (16.151) . 

From the definitions, we have 

OO OO 

b n ,0 = ^ ( /3n+(+l/3 n +/+i, r ra,0 = 'y ' Pn+7+lPra+7+l- 

7=0 7=0 

Since U is unitary, we have, for j, k > n, 

PjPk = PjPk{Iq + Aj)(/ g + Afc). 

By Proposition [HU] and the equality (1 + a ;) 2 — 1 < 2a;(l + a ;) 2 for x > 0, we have 

\\(I q + A j)(Jq + Afc) — /qll = ||Aj + A£ + AjA£|| 

< (1 + ||A J ||)(1 + ||A*,||) - 1 < (1 + Mn~ 1 ) 2 - 1 

< 2Mn~ 1 (l + Mn- 1 ) 2 

for j, k > n. Thus, 

\\ b l,o - r lfilg\\ < 2Mn _1 (l + Mti -1 ) 2 ^, ti G N. 

In the same way, we have, for k = 1, ..., 

ft - rl k 0 I q \\ < 2kMn~\l + Mn’ 1 ) 2 ^, n G N. 

Take f > 1 such that t 2 sin( 7 r|d|) < 1. Define r 2 k G (0, oo) by 

OO 

( 7 T _1 arcsina ;) 2 = ^ T 2 kX 2k , |a;| < 1 (6.19) 

fe=l 

(cf. Lemma 3.1 in [SF]). Then, as in the proof of Proposition 3.2 in jJS, there exists 
an N G N such that 

1 + Mn -1 < t, r 2k 0 < rz. 1 {t sin(7r|d|)} 2fe r 2 7c (fc G N, n> N). 
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Combining, we have, for n > TV, 

oo 

\\n{v n - Voo) - n(u„ - l>oo|| < ||co|| 2 E-ll^o - rl k 0 I q \\ 

k= 1 
oo 

< n _1 M||c 0 || 2 ^2 2 kr 2 k{t 2 sin(7r|<i|)} 2fc , 

k=1 

whence ||n(u n — Voo) — n{u n — l)voo|| = 0{n^ x ) as n —> oo. This and Proposition 
16.11 yield (11.411 . We obtain m by applying El to the time-reversed process 
{X k }. □ 


6.4. Asymptotics of the PACF. In this section, we derive the precise asymp¬ 
totics of the PACF for a q -variate FARIMA process {X k } with (F). Recall U from 
(16.161) . As above, {c n } and {c n } denote the forward and backward MA coefficients 
of {X k }, respectively (see ( 12 .lip and (12.121) 1. 

First, we consider the asymptotics of (f> n ,n in (El- 


Theorem 6.6. Let d £ (—1/2,1/2) \ {0}, and let {X k } be a q-variate FARIMA 
process with (F). Then 

4>n,n = —cqUcq 1 + 0(n~ 2 ), n y oo. 

Proof. The proof is similar to that of Theorem l6.5l From the representation of 4>n t n 
in Theorem 15.21 we have 

( OO \ OO 

^2 ) C-0 1 wit h (f k n '.= ^2 tffjPn+j ■ 

fc =0 / i =0 

Similarly, the scalar coefficient for a univariate FARIMA(0, d, 0) process {P/c}, 
which is given by m , can be expressed, in terms of {pj} in (16.51) only, as 

OO OO 

1pn,n = with if k := ^ r^jPn+j, 

k =0 j =0 

where r k ■ are defined by the recursion (16.181) . We define e := d/\d\ so that \p n \ = 
ep n . Let A n and M be as in Proposition 16.41 
First, since 

4*n = Pn = Pn{Iq + A n )t/, lf n = p n , 
it follows from Proposition 16.41 that 

\\4>i - i’nUW < Mn~ 1 ep n = Mu-hip?,. 


Next, we have 


OO / OO 


b n — ( ^2 Pn+t+lPn+j+l+l J Pn+j > 

j=0 \l =0 / 


OO / OO 


' l l'n = E(E Pn+l+lPn+j+l+1 J Pn+j- 

j—0 \l=0 J 

Then, since U is unitary, we have, for j, k,l > n, 


PjPtPi = PjPkPi(I q + A j){I q + A l){I q + A ,)U. 
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By Proposition [6J] and the equality (1 + a;) 3 — 1 < 3.t(1 + *) 3 for x > 0, we have 

\\{Iq + Aj)(I q + A* k )(I q + A;) — I q \\ 

= II Aj + A k + A; + AjAl + AjAi + AlAi + Aj A£Aj|| 

< (1 + II Aj||)(1 + || A fe ||)(1 + ||A/1|) - 1 < (1 + Mn- 1 ) 3 - 1 

< 3Mn~ 1 (l + Mn- 1 ) 3 
for j, k,l > n. Thus, 

II (fin - il>nu\\ < 3Mn _1 (l + Mn^feip 1 , n G N. 

In the same way, we have, for fc = 0,1,..., 

Ul - ^nU\\ < (2k + l)Mn~\ 1 + Mn~ 1 ) 2k+1 eipn, n G N. 

Take t > 1 such that t 2 sin(7r|d|) < 1. Define T 2 k+i G (0,oo) by 

OO 

7T _1 arcsina; = ^ r 2 fc+ia; 2fc+1 , |a;| < 1 (6.20) 

fc=0 

(cf. Lemma 3.1 in [26]). Then, as in the proof of Proposition 3.2 in [26], there exists 
an N G N such that 

1 + Mn- 1 < t, ap* < n _1 {tsin(7r|d|)} 2fc+1 T2fc+i (k G N U {0}, n > N). 
Combining, we have, for n > N, 

'H'tfn.n — dC(j U Cq 

n — a 

OO 

= n ll^n,ra — 4>n,nCoUCQ 1 \\ < || C 0 || || Cg 1 1| ^ U \ \ <j>* - if’fU \ \ 

k—0 

oo 

<n- 1 || Co ||||c 0 - 1 ||M^(2A : + 1 )r 2fe+ i{t 2 sin(7r|d|)} 2fc+1 , 
k= 0 

whence ||n0 ni „ — dc^Ucf} 1 || = 0(n _1 ) as n —> oo. Thus the theorem follows. □ 

Recall Uqo and v from (16.161) and (16.171) . respectively. Notice that vf^^ 2 c 0 
(resp., v^/ 2 co) is the polar part of cq (resp., Co). Recall the PACF a n of {X k } 
from Section [5] The above theorem gives the following rate of convergence for a n 
as n —> oo. 

Theorem 6.7. Let d G (—1/2,1/2) \ {0}, and let {Xk} be a q-variate FARIMA 
process with (F). Then 1 1. 61) holds with the unitary matrix V G C qxq given by 

V '■= v^ 1/2 c 0 ■ U ■ (u“ 1/2 c 0 )*. 

Proof. From the first equality in (1531) in Theorem 15.31 and Proposition 14.41 we 
have v n > i^. Therefore, we see from Theorem 16.51 and 0] Theorem X.3.7] that 
|| Vn 2 — Voq 2 || = 0(n _1 ) as n —> oo. Similarly, we have vl/ 2 = vU? + 0(n -1 ) as 
n —> oo. 

From v n > v ^ and [U Propositions V.1.6 and V.1.8], we have vf 1 ^ 2 < vf^^ 2 , so 
that ||W 1/2 || < ||u^ 1/2 ||. Hence, as n —> oo, 

k i/2 - <* i/2 ii = ii*.„- ,/ 2 (A 2 - »; / 2 )«.i ,/2 ii 

<ll»i 1,2 || 2 |l4 ,2 -»i( 2 |l=0(n-'). 
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Combining these with (15.71) and Theorem 16.61 we have 

- 1/2 , - 1/2 

na n = v n _\ ■ n<j> n ,n ■ f n -i 

= i v ™ /2 + 0 (n _ 1 )}{dc 0 C/co 1 + 0 (n _ 1 )}{i5 ^ 2 + 0 (n _1 )} 

= dv“ 1/2 c 0 • U ■ (v~ 1/2 co)* + Oin- 1 ) 

as n-> oo. Thus the theorem follows. □ 


Remark 4. If we choose g and g so that both g(0) > 0 and g(0) > 0 hold, then we 
see from (16.121) . (16.161) and (16.171) that cq = 'wj 2 and Cq = vt£ 2 , whence V = U. 


6.5. Baxter’s inequality. In this section, we present Baxter’s inequality for mul¬ 
tivariate FARIMA processes with 0 < d < 1/2. It extends the corresponding 
univariate result in [26 . 

For d e (—1/2,1/2) \ {0}, let {Xk} be a g-variate FARIMA process with (F). 
Recall the forward and backward AR coefficients a n and a n of {A - *;} from (12.111) 
and (12. 1 2[) . respectively. They satisfy 


n 1+d a n + 


F(-d) 


5(1) 


-l 


n 1+d a n + 


-l 


:{ 5 tt(l)*} 


F(-d) 

(cf. [231 Lemma 2.2]). In particular, we have 

Il5(l) 1 || 


= 0(n ), n —> oo, 


= 0(n ), n —> oo 


lim n 1+d II 


\n-d)\ ’ 
ll{5j(l)*}- 1 H 


lim n + ||dj = . 

n-Hx> |1 ( — a) | 

We see from (16.231) and (16.241) that (12.141) holds if0<d<l/2. 
Recall <t> nt k and </>*, from (15.11) and (12.161) . respectively. 


( 6 . 21 ) 

( 6 . 22 ) 


(6.23) 

(6.24) 


Theorem 6 . 8 . Ford £ (0,1/2), let {Xk} be a q-variate FARIMA process with (F). 
Then the forward finite and infinite predictor coefficients (j) n ,k and 4>k, respectively, 
°f {X k } satisfy 

n 

^2Un,j ~ <Pj\\ = 0(n~ d ), n^r oo. 

3 = 1 

Proof. For k = 0,1,..., we show by induction on k that 

\\b k n ,i\\ < (1 + Mn- 1 )^, n £ N, l £ N U {0}, (6.25) 

where M is a positive constant satisfying (16.141) and ; are defined by (16.181) . 
Indeed, the case k = 0 is evident by the definitions ; = SoiI q and z = <5oz- 
Assuming (16.251) for k > 0, we see from Proposition 16.41 that 

OO 

iiO^Eii<Jiii/w m+ iii 

m =0 

oo 

< (1 + E r^ m Pn+i+m + i = (1 + Mn' 1 )^ 1 ^ 1 . 

m—0 


Thus (16.251) also holds for k + 1. 
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Define Tk £ (0, oo) by (16.191) and (16.201) . Then we see from Proposition 3.2 in 
[26] that, for any t > 1, there exits an N £ N such that 

nr^ i < Tk{t sm(nd)} k , 1 + Mn~ l <t (l £ N U {0}, k £ N, n > N). 

Here we take t > 1 such that t 2 sin(7T(i) < 1. Then, from (16.251) . 

OO OO 

"DiOs £ Tk{t 2 sin(7rd)} fc < oo, /£ffU {0}, n> N. (6.26) 

fc=l fc=l 

From (j)j = codj = cq ^n i a j+i and Theorem 15.41 we have 


OO OO oo oo 

^2/c „ | „ \ ' \ A i2k+l 


EE ^ ’ ~ a n-j+l+ 1, 


<t>n,j ~ <t>j = C 0 EE ^n,l a j+l + C 0 

fc=l Z—0 fc=0 Z—0 

whence 

TL 71/ OO OO 

Ell^-^ll<EE^Ell & vll’ 

j=1 j =1 Z—0 fc—1 

where Rj = max{||</>j ||, ||^||}. Since n 1+d 7?„ is bounded by (16.231) and (16.241) . we 
have, for n £ N, 


-l +d ' 


j =i i=j 

Hence we see from (16.261) that, for n > N , 


f 1 1 

1 m oo f 

\ sn P i 1+d R l \ l 

supm-W^^/- 1 -' 

UeN J | 

;=i i=o J 


< oo. 


^E^b _ ^11 - { 'Y. T k{r 2 sm(Trd)} k V < sup m 1+d E E R ‘ 

1 1 1 mGN 


i > < OO. 


J =1 


,fc=l 


j=i 


The desired result follows from this. 

Since cf> n = coa n , we see from (16.2ip that 


□ 


n 1+d 4> n + 


T(-d) 


co3(l) 


-1 


In particular, 


lim n 1+d ||0„|| = 


= 0(n ), n —y oo. 


l|cos(l)" 


|r(-d)| ‘ 

From this and HD Proposition 1.5.8], we obtain the following asymptotic behavior 
of T/T=n +1 UoW as n —>■ oo: 

°° |co<?(l)— 1 II 


lim n d Ill’ll = 


. 7 = 71+1 


F(l-d) ‘ 


(6.27) 


Here is Baxter’s inequality for multivariate FARIMA processes with 0 < d < 1/2. 


Theorem 6.9. Ford £ (0,1/2), let {A+} be a q-variate FARIMA process with (F), 
and let (f> n ,k and 4> n be as in Theorem 1 6. Then, there exists a positive constant K 
such that m holds. 

Proof. In view of (16.271) . Theorem 16.81 gives the desired assertion. □ 

By applying Theorem 16.91 to the time-reversed process {A+}, we immediately 
obtain the following backward Baxter inequality. 
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Corollary 6.10. For d e (0,1/2), let {Xk} be a q-variate FARIMA process with 
(F), and let f> nt k and <f>k be the backward finite and infinite predictor coefficients, 
respectively, of{Xk}- Then, there exists a positive constant I\ such that 

n oo 

- 4>j\\ < K Y, Ill'll- «eN. (6.28) 

3 =1 j=n +1 
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